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[ABSTRACT] 

This invention relates to an apparatus and a method for recognizing written characters. 
Specifically, this invention provides an apparatus and a method adapted for recognizing written 
Korean characters which are written in such a manner that the elements for a syllabic are 
continuously written. The apparatus comprises: a character input section for receiving input of 
character data from a user; a preprocessing section for removing noise in the input data and 
extracting representative points from the data; a dictionary section for storing information for 
initial elements, medial elements, and final elements, and syllabics comprising the initial 
elements, medial elements and the final elements; and a recognition section for recognizing the 
written characters referring to the information stored in said dictionary section. 

[REPRESENTATIVE DRAWING] 

FIG. 2 

[SPECIFICATION] 
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(TITLE) 

AN APPARATUS AND A METHOD FOR ON-LINE RECOGNITION OF WRITTEN 
CHARACTERS 

(BRIEF DESCRIPTION OF THE DRAWINGS) 

FIG 1 is a block diagram representing a conventional method for on-line recognition of 
written characters. 

FIG. 2 is a block diagram representing a system for on-line recognition of written characters 
according to the present invention. 

FIG. 3 represents an example of coordinate points for a syllabic. 

FIGs. 4a-4c represents a preprocessing step according to one embodiment of the present 
invention. 

FIG 5 represents an example for searching representative points by linear adaptation. 
FIG 6 is a block diagram of a recognition section according to the present invention. 
FIG 7 is a flow chart for showing operation of the initial element recognition section in FIG 

6. 

FIG. 8 is a flow chart for showing operation of the initial-medial elements connection 
recognition section in FIG 6. 

FIG 9 is a flow chart for showing operation of the initial-medial-final elements connection 
recognition section in FIG 6. 

FIG 10 represents an example of a classification method by main class. 

FIG 1 1 is a flow chart for showing operation of the medial element recognition section in 
FIG 6. 

FIG 12 is a flow chart for showing operation of the medial-final elements connection 
recognition section in FIG 6. 

FIG 13 is a flow chart for showing operation of the final elements recognition section in 
FIG 6. 

FIG 14 is a flow chart for recognizing elements and syllabics according to the present 
invention. 

FIG 1 5 is a flow chart for showing operation of a dictionary generation section according to 
the present invention. 

* BRIEF DESCRIPTION OF SYMBOLS IN THE DRAWINGS* 
21 : character input section 22: preprocessing section 

23: recognition control section 24: dictionary generation section 

25: dictionary section 30: first recognition section 

3 1 : second recognition section 32: third recognition section 


2 


33: syllabic codes storing section 


34: recognized character output section 


(DETAILED DESCRIPTION OF THE INVENTION) 

The present invention relates to a method and an apparatus for recognizing Korean written 
characters, and more particularly, to a method and an apparatus for on-line recognition of 
Korean written characters which are written not in such a manner that each element is separate 
from each other but in such a manner that each element is connected and continuous, and which 
is capable of being adapted to a writing habit. 

The world of today is an information society. The amount of information which is 
generated, delivered, and processed is increasing at a rapid speed. It is very important to 
efficiently obtain, analyze, and process the necessary information. A computer is one of the 
means playing such a role since a computer can store and process a large amount of information. 
However, inputting information contained in documents to the computer is still performed by 
humans using a keyboard. Therefore, it requires many people and long time to input 
information to the computer. Automation of inputting information is required for establishing 
a real information society. 

It requires a character recognition system that is adapted to receive images of documents 
made manually or by a printing device, analyze them, transform characters on the documents 
into computer internal codes, and generate a transformed text file. 

A character recognition scheme is categorized into a printed character recognition scheme 
and a written character recognition scheme according to whether target characters are printed or 
written. The written character recognition scheme is further categorized into an on-line 
recognition scheme and an offline recognition scheme according to a type of character image 
information generation. According to the on-line written character recognition scheme, while 
users write characters with a stylus on a tablet as if writing characters on paper, a stroke and a 
sequence of the written characters are detected. Generally, the detection is performed by using 
an electromagnetic/electrostatic scheme or a pressure sensitive scheme. These schemes have 
been developed recently for a keyboard-free computer. 

According to the off-line written character recognition scheme, an image of characters 
written on paper is obtained with an optical input device such as a scanner or a camera. This 
scheme is used, for example, for automatic input of bills. 

Meanwhile, character recognition is a scheme of recognizing a character image and 
generating corresponding computer codes. In another aspect, character recognition includes a 
document recognition scheme of analyzing a structure of a document, including non-character 
areas like a picture area, selecting a text area, and generating computer codes corresponding to 
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characters in the text area. In the below, a character recognition scheme, not a document 
recognition scheme, is described and explained. 

Character recognition is performed by using a method selected from a Template Matching 
Method, a Statistical Method, a Structural Method, an Artificial Neural Network, and a 
combination thereof. 

According to the Template Matching Method, a character image to be recognized is stored 
in a 2-dimensional array, an image of an input character is compared with a pre-stored character 
image by a unit of a pixel, and the input character is determined to be the character in the case 
where the number of mismatched pixels is the minimum. According to the Statistical Method, 
the sufficient number of character images is obtained as to each character to be recognized, and 
N characteristic values are extracted for each character to represent it as an N-dimensional 
spatial vector. An average value of the vectors is calculated and stored as a characteristic 
vector for each character. A character which has a characteristic vector nearest to that of the 
character to be recognized is determined to be corresponding to the character to be recognized. 

Further, the Structural Method uses basic elements such as strokes that compose a character 
and relationship between them. The Artificial Neural Network uses a system in which a 
number of simple processors are connected as a network, like a human neural network, to 
recognize a pattern of characters. 

The above methods and other conventional methods for character recognition are based on a 
character being written in such a manner that each element is separate from each other element. 
Further, most of the conventional methods for character recognition are used for recognizing 
printed characters. Therefore, the above methods are not appropriate for recognizing written 
characters. 

Referring to FIG 1 , a conventional method for recognizing characters is described. 

In FIG 1, 11 is a character input section for inputting written characters, which comprises a 
tablet and a stylus. 12 is a recognition control section for controlling a flow of character 
recognition. 13 is a dictionary section for storing samples of characters to be recognized. 14, 
15, and 16 are an initial element recognition section, a medial element recognition section, and a 
final element recognition section for respectively recognizing an initial element, a medial 
element, and a final element. 17 is a recognized character output section for outputting a 
recognized character. An operation of the above apparatus is described hereinafter. 

A Korean character is input using the tablet and stylus. The input character is recognized 
as N strokes and input to the character recognition section 1 1 . The recognition control section 
12 controls the initial element recognition section 14 to compare some of the N strokes in the 
front portion with initial element related data in the dictionary section 13. 
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After the initial element recognition section 14 recognizes the initial element from the N 
strokes, the strokes which are used for initial element recognition are excluded and the 
remaining strokes are used for medial element recognition by the medial element recognition 
section 15. If the number of remaining strokes is above 5, which is the maximum number for 
the medial element, the medial element recognition is performed with the 5 strokes of the 
remaining strokes at first, and is repeated, reducing the number of the strokes by 1. If the 
number of remaining strokes is below 5, then the medial element recognition is performed with 
the all remaining strokes. 

The final element recognition is performed by the final element recognition section 12, only 
when strokes are remained after the medial element recognition. The recognition control 
section 12 controls the flow of the above operation, and if the recognition of each element of the 
character is completed, the recognized character output section 17 outputs the recognized 
character which is obtained by combining each element. 

The conventional recognition method is not operable when each element of the character is 
connected to each other. Therefore, it gives a big burden and confusion to users. 

The conventional recognition method is not adaptable to a unique habit of users. 
Therefore, the users have to change their writing habit to use the conventional on-line 
recognition method. 

The object of the present invention is to provide an apparatus and a method for on-line 
recognition of Korean written characters that are written in such a manner that each element is 
connected to each other. 

Another object of the present invention is to provide a character recognition method 
adaptable to a user's writing habit. 

To accomplish the purpose, the present invention provides an apparatus including: a 
character input section for receiving input of character data from a user; a preprocessing section 
for removing noise in the input data and extracting representative points from the data; a 
dictionary section for storing information for initial elements, medial elements, and final 
elements, and syllabics comprising the initial elements, medial elements, and final elements; 
and a recognition section for recognizing the written characters referring to the information 
stored in said dictionary section. 

Another aspect of the present invention provides a learning section for learning patterns 
which have not been recognized. 

Hereinafter, the present invention is described in detail referring to the drawings. 

FIG. 2 a block diagram of the on-line character recognition apparatus for Korean written 
characters according to the present invention. In FIG. 2, 21 is a character input section for 
receiving input of Korean characters from users. 22 is a preprocessing section for removing 
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noise in the input data and extracting representative points from the data. 23 is a recognition 
control section. 24 is a dictionary generation section. 25 is a dictionary section storing 
information with respect to strokes as samples. 

An operation of a Korean written character recognition system comprising the above 
sections is described hereinafter referring to FIGs. 3 to 13. 

When a user writes characters on a tablet with an electronic pen, the written information is 
input to the character input section 21. The input information is not a shape of the written 
character itself, but an array of points in a coordinate of the tablet. 

Generally, the tablet includes conductors in a shape of a lattice disposed according to x- and 
y-axes, each of which has 0.1-0.5 inches gap from neighboring conductors. The electronic 
pen comprises a coil at its tip. When the tip of the pen is contacted to the tablet, one of the coil 
and the lattice is activated by an electromagnetic pulse, and the other detects an induced voltage 
or current. Next, the coordinate (x, y), which is nearest to the location of the tip of the pen is 
determined by scanning the conductors of the tablet, and the accurate location of the tip is 
calculated by interpolation. 

The character input section generates an array of points and sends it to the preprocessing 
section 22. 

The preprocessing section 22 performs the following processes prior to shape analysis. 

1) An external segmentation process for dividing input data by a unit of a character or word. 

2) A noise reduction process for minimizing mechanical defects and errors caused by 
malfunction of the input device and user's mistakes. 

3) A normalization process for de-skewing the characters, arranging the characters so that 
the bottoms of the characters are put on a line, adjusting the length of the strokes to be constant, 
and adjusting the size of the characters to be constant. 

Representative points are obtained by monotone separation, linearization, and noise 
reduction according to the above processes. 

The monotone separation means a process for searching a coordinate point at which the 

coordinate values change sharply. For example, the character comprising 4 strokes has an 

array of points comprising 30 points as described in FIG 3. The stroke comprises 12 

points, the x-axis values of which increase monotonously to the 5 th point, and decrease from the 
6 th point. Herein, the 5 th point is referred to as a monotone separation point. Similarly, the y- 
axis values increase to the 3 rd point and decrease from the 4 th point. Therefore, on the y-axis, 
the 3 rd point is a monotone separation point. 
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FIG. 4a shows the result of the above monotone separation. The beginning and ending 
points of each of the strokes, and the monotone separation points are called representative points 

of the strokes. Comparing FIG. 3 and FIG 4a, the final element "L-" of the character is 

significantly bent in FIG 3, but it becomes a line in FIG 4a. As shown in FIG 4a, the 
monotone separation scheme has difficulty in recognizing a smoothly curved stroke. To make 
up for this defect, a process of linear adaptation is employed. 

The linear adaptation is performed with the monotone separation points included in a stroke. 
Referring to FIG 5, two adjacent monotone separation points Pi and Pj define a line (hereinafter, 
referred to as a segment) of length L. The distances lm between the segment and the points 
between the two adjacent monotone separation points is obtained. The point having the largest 

curvature lm/L is defined as a new representative point. In the case of the character "Zl" in 

FIG 3, the 2 nd point on the final element "L" is a new representative point, and the result is 
shown in FIG 4b. 

The last segment of "H" and the last segment of the first stroke of " I" " are unnecessary 

segments caused by a user's undesirable habit or malfunction of the tablet. Such unnecessary 
segments are referred to as protrusions, which have to be removed by a protrusion removal 
process. A segment is defined as a protrusion when the segment is the last segment of the 
stroke, has a predetermined angle with an adjacent segment, and has a predetermined length. 

FIG. 4c shows the result of the above processes. The character recognition according to 
the present invention is performed using the representative points obtained through the above 
processes. 

The characters comprising a plurality of representative points are input to the recognition 
control section 23 in a format of an array of the representative points. Specifically, the 
character C comprising N strokes is represented as S b S 2 , S 3 ,..., S N . the j th stroke Sj is 
represented as p i; p 2 , P3,...p n . The recognition control section performs recognition of initial 
element, initial-medial connection, and initial-medial-final connection, in sequence. The 
recognition for each element is performed by comparing the data stored in the dictionary section 
25, which stores prototypes of each element. 

Operation of a first recognition section is described in detail referring to FIG 7. In a step 
SI 10, it is determined if the number of strokes is above 12. If the number is above 12, a 
resultant value obtained by subtracting 12 from the number of strokes is set as a current location 
in step SI 30. If the number is equal to or below 12, the reference location is set to 1 in step 
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S120. The reason for comparing the number of strokes with 12 is that the maximum number 
of strokes in an initial element is 5 and the maximum number of strokes in a medial element is 7. 
For example, suppose that an input character has an initial element of 3 strokes, a medial 
element of 4 strokes, and a final element of 7 strokes. The input character has 14 strokes in 
total. Therefore, the reference location is 2 according to the above rule. From that, it is found 
out that the initial element comprises at least 2 strokes, because the reference location indicates 
the minimum number of strokes of the initial element. 

After determining the minimum number of strokes of the initial element, a stroke having 
representative points from a beginning location to the reference location is compared with a 
prototype stroke stored in an initial element dictionary of the dictionary section in step SI 40. 
The result of the comparison is written in a memory which stores element codes. Then, the 
reference location is increased by 1 in step SI 50. This is for comparing the stroke having the 
increased reference location with the data stored in the dictionary section gradually. The step 
of comparison and writing is repeated, increasing the reference location. In step SI 60, it is 
determined if the reference location is less than 8 and less than the maximum number of strokes. 
If so, the process is terminated. If not, the process returns to the step SI 40. 

Then, i candidate elements which have higher matching scores are selected from the 
combination of the strokes for an initial element. 

After the recognition of an initial element, a process for recognizing initial-medial 
connection is performed, which is described hereinafter referring to FIG 8. 

It is determined if the number of strokes is above 7 in step S210. If the number is above 7, 
a resultant value obtained by subtracting 7 from the number of strokes is set as a current 
location in step S230. If the number is equal to or below 7, the reference location is set to 1 in 
step S220. The reason for comparing the number of strokes with 7 is that the maximum 
number of strokes in a medial element is 7. 

More specifically, three cases can be considered according to the number N of strokes of a 
character as follows. (1) In the case that N is 13~20, a recognition for an initial element is 

performed as to the range (N-12)~8 of the number of strokes. For example, the character "IS!"" 

has 16 strokes in total, and thus the recognition for an initial element is performed from the 
location of the 4 th stroke to the 8 th stroke. (2) In the case that N is 8-13, the recognition for an 
initial element is performed from the 1 st stroke to the 8 th stroke. (3) In the case that N is less 
than 7, the recognition for an initial element is performed from the 1 st stroke to the (N-l) th stroke, 
because a medial element has at least one stroke. 

After the minimum reference location is determined, an initial-medial connection type 
having representative points between the beginning location to the reference location is 
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compared with a prototype stroke stored in an initial-medial connection dictionary in the 
dictionary section in step S240. The result of the comparison is written in a memory which 
stores element codes. Then, the reference location is increased by 1 in step S250. This is for 
comparing the stroke having the increased reference location with the data stored in the 
dictionary section gradually. The step of comparison and writing is repeated, increasing the 
reference location. In step S260, it is determined if the reference location is less than 12 and 
less than the maximum number of strokes. If so, the process is terminated. If not, the process 
returns to the step S240. 

Then, i candidate elements which have higher matching scores are selected from the 
combination of the strokes for an initial-medial connection part. 

After the recognition of initial-medial connection candidates, a process for recognizing 
initial-medial-final connection is performed, which is described hereinafter referring to FIG. 9. 

The recognition for an initial-medial-final connection is for recognizing the character in 
which initial, medial, and final elements are connected with each other, and performed only 
once with the total number of strokes by referring to an initial-medial-final connection 
dictionary in the dictionary section in step S300. 

After the recognitions for an initial element, an initial-medial connection, and an initial- 
medial-final connection are completed, five candidates are selected from the resultant (ix3) 
candidates. After the recognition by the first recognition section, a main classification process 
is performed so as to reduce the number of candidate prototypes which are used in a second 
recognition section and a third recognition section. According to the main classification 
process, initial elements are classified based on the number of strokes and the number of 
rotations to the directions of the x-axis and the y-axis when the stroke is monotone-separated, 
and connection types are classified based on one of the above characteristics. In the case of the 
connection types, as the number of connection types is relatively smaller, it is not necessary to 
use all the above characteristics for the main classification. 

The dictionary section classifies elements having a common characteristic with respect to 
the total number of strokes, the number of x-axis rotations, and the number of y-axis rotations as 
a group (class). The recognition control section determines the characteristics of an input 
element and determines which group the input element belongs to. The main classification 
process is for reducing the number of comparisons by performing the comparison with the 
prototypes in the same class. The number of x-axis rotations and the number of y-axis 
rotations means the number of changes of direction of a pen toward each of the x-axis and the y- 
axis, respectively. It is assumed that the strokes composing an element are connected and 

continuous. For example, FIG 10 shows an element "P" wherein the x-axis direction of a 
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pen is changed twice, at point 4 (right to left) and point 6 (left to right). Similarly, the y-axis 
direction of the pen is changed twice, at point 2 and point 4. 

The comparison of elements is performed with the prototypes which have the same 
characteristic. The result of the first step of recognition may include one of an initial element, 
an initial-medial connection element, and an initial-medial-final connection element. If the 
first step of recognition outputs only the initial element, the second step of recognition is 
performed for the remaining strokes excluding the strokes which have been used for the initial 
element. 

The second step of recognition for recognizing a medial element is described hereinafter 
referring to FIG 1 1 . 

The number of strokes which have been used in the first step of recognition for recognizing 
an initial element is excluded and the next number of strokes is set in step S410. In step S420, 
it is determined if the recognition for a medial element has already been performed at the set 
location. If so, the process is terminated. If not, the following steps are performed. 

As similar with the steps in the first step of recognition, it is determined if the number of 
remaining strokes is above 7 in step S430. A reference location to be searched is determined 
from a beginning location excluding the strokes which have been used for recognition of an 
initial element in steps S440 and S450. A process for recognizing a medial element is 
performed in a corresponding range in step S460. The reference location is increased by 1 in 
step S470. The step S470 is repeated until the increased number of strokes is less than 5 and 
up to (maximum- 1) in step S480. 

According to the above processes, possible combinations of strokes as a medial element 
with one initial element are recognized, and j candidates per combination are selected. 

Connection recognition in a medial-final connection recognition section 31b of the second 
recognition section is described referring to FIG. 12. The medial-final connection recognition 
section 31b obtains characteristics used for the main classification process and performs 
comparison with respect to the prototypes which have the same characteristics. All remaining 
strokes after the recognition of an initial element are set as the number of strokes for searching 
in step S500. The medial-final connection recognition is performed only once. In this second 
step of recognition, j candidates per one initial element are selected (steps S510 and S520). 

A third recognition section as a final element recognition section performs recognition of a 
final element with the remaining strokes when the result of the second step of recognition has 
only a medial element. The recognition of a final element is described referring to FIG 13. 

The number of strokes which follows the medial element is set in step S610. In step S620, 
it is determined if the recognition for the medial element has already been performed at the set 
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number of strokes. If so, the process is terminated. If not, it is determined if the set number 
of strokes is larger than the total number of strokes of an input pattern in step S630. 

If the set number of strokes is larger than the total number of strokes in the step S630, it is 
determined that the character does not have a final element in step S640. If the set number of 
strokes is equal to or less than the total number of strokes, it is determined whether the strokes 
match with a final type from the corresponding set location to the total number of strokes in step 
S650. If the strokes do not match with a final type, the process is terminated, and if the strokes 
do match with a final type, the process for recognizing a final element from the corresponding 
set location to the total number of strokes is performed in step S660. 

Candidates for a final element are selected up to k per each final element. After the third 
step of recognition, ixjxk candidate characters are obtained and stored in an element codes 
storage section 33. A recognized character output section 34 selects, as recognition candidates, 
m characters having a high integral matching score from the ixjxk candidate characters stored in 
the element codes storage section 33 and outputs them. 

A process for recognizing each element and each connection type element performed by the 
recognition control section 23 is described in detail referring to FIG. 14. The recognition 
control section 23 extracts characteristics from input elements in step S700. A portion from a 
beginning one to a last one of the strokes to be recognized is assumed to be one element or one 
connection element, and the main classification process is performed with respect to each 
element and connection element. The main classification process is performed by searching a 
class containing elements and connection elements having a common characteristic in the 
dictionary section (steps S710 and S720). In the step S720, if a class for a certain element 
does not exist, the process is terminated and a search for the next element is performed. 

In the step S720, if the class for the certain element exists, the element is compared with all 
patterns of element prototypes contained in the class in step S740. The comparison (matching) 
is performed by units of a stroke. Therefore, the result of the matching is the sum of each 
matching result for each stroke. After the matching, the result of the matching is arranged 
according to a matching score in step S750. Candidates are selected according to the matching 
score and registered in a table in step S760. 

The dictionary is used for recognition in the above process. The dictionary may be 
generated by a dictionary generation section 24, and its method is described hereinafter referring 
to FIG 15. 

A recognition system collects data for generating the dictionary by having a writer write a 
specific character on a tablet according to his writing habit. The collected data are processed 
according to the process described above as preprocessing, and the information as to the number 
of strokes for each element is acquired in step S800. Then, characteristics of each element are 
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extracted in step S810. Searching an existing library is performed for a corresponding element 
in step S820. 

It is determined if a class for the corresponding element exists in the existing library in a 
step S830. If the class does not exist, the corresponding element is normalized and registered 
in the library as a new element in steps S840 and S850. When the element is registered in the 
library, it is stored in a sequence of an initial element, an initial-medial connection type, an 
initial-medial-final connection type, a medial element, a medial-final connection type, and a 
final element. The data structure of the dictionary has a tree structure to which characteristics 
used in the main classification are applied. Element codes, connection element codes, and an 
array of representative points of representative patterns (prototypes) of each element and 
connection type element are stored in the last node of the tree structure. 

However, if the class exits in the step S830, each element is compared (matched) with 
element prototypes contained in the class in step S860. Then, when the matching score of the 
element which has the best score among elements having the same element code is above a 
predetermined value, the process goes to the step S840 and the above processes are repeated. 
When the matching score of the element which has the best score among elements having the 
same element code is less than the predetermined value and the matching score of the element 
which has the best score among elements having the different element code is less than the 
predetermined value, the process goes to the step S840. Otherwise, the process is terminated. 

Further, the above process is used for improving a recognition rate by remembering mis- 
recognized characters or non-recognized characters or a writer's writing habit. The process 
may be referred to as an update of the dictionary. 

Operation of a dictionary update section, although not shown in the drawings, is described 
hereinafter. There are two methods to update the dictionary. Firstly, prior to using a 
recognition system, a user is requested to write specific characters by the system. The system 
shows several predetermined characters and urges the user to write the characters according to 
his writing habit, and then stores information as to the pattern of elements and the relationship 
between elements. Secondly, when failing to recognize a certain character, the system updates 
a dictionary by inputting a character code and information of the relationship between elements 
for the corresponding elements. The first method has a disadvantage of requiring some time 
for generating a dictionary, but has the advantage of a high recognition rate. Meanwhile, the 
second method has a disadvantage with respect to a recognition rate, but has advantage that it 
does not require training prior to using the system. 

According to the present invention, users do not have to write characters in such a manner 
that each element composing the character are separate from each other. Therefore, users write 
characters more freely according to their habit as if they were writing characters on paper with a 
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pen. Further, a recognition rate is improved by updating a dictionary with a user's writing 
patterns. Thereby, a compact computer without a keyboard can be implemented and a 
beginner can easily use the computer. 

[(57) CLAIMS] 

1 . A method for recognizing Korean character on-line, comprising: 

a preprocessing step for removing noise and unnecessary portions from Korean 
character data inputted from an external source and extracting representative points from the 
character data; 

a first recognition step for recognizing an initial element, an initial-medial connection, 
and an initial-medial-final connection with the representative points by referring to a dictionary; 

a second recognition step for recognizing a medial element and a medial-final 
connection with elements of the number of strokes which remain after recognizing an initial 
element in the first recognition step by referring to the dictionary; and 

a third recognition step for recognizing a final element with the elements of the number 
of strokes which remain after recognizing a medial element in the second recognition step by 
referring to the dictionary. 

2. The method according to Claim 1, further comprising an element registration step for storing 
an element corresponding to the representative points in the dictionary when the element is not 
searched from the dictionary. 

3. The method according to Claims 1 or 2, wherein the input Korean character data are written 
by hand. 
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